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Abstract 


Proponents of open educational resources claim that significant cost savings are possible 
when open textbooks displace traditional textbooks in the classroom. Over a period of two 
years, we worked with 20 middle and high school science teachers (collectively teaching 
approximately 3,900 students) who adopted open textbooks to understand the process 
and determine the overall cost of such an adoption. The teachers deployed open textbooks 
in multiple ways. Some of these methods cost more than traditional textbooks; however, 
we did identify and implement a successful model of open textbook adoption that reduces 
costs by over 50% compared to the cost of adopting traditional textbooks. In addition, we 
examined the standardized test scores of students using the open textbooks and found no 
apparent differences in the results of students who used open textbooks compared with 
previous years when the same teachers’ students used traditional textbooks. However, giv¬ 
en the limited sample of participating teachers, further investigation is needed. 

Keywords: Cost; open educational resources; remix; reuse; open textbooks; electronic 
textbooks; open access 


Introduction 


Public education budgets continue to shrink while the public’s expectations for the perfor¬ 
mance of its educational institutes continue to increase. This tension places many school 
districts in a difficult position as they attempt to find ways to do more with less (Odden et 
al., 2007). Over the last two decades, textbooks and other educational resources have re¬ 
peatedly undergone scrutiny in an effort to determine whether the amount of learning they 
facilitate justifies their costs (Card & Krueger, 1996; Chaudhary, 2009; Hanushek, 2002). 
Open education resources (OER), educational materials that are available at no cost and 
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under open copyright licenses or in the public domain, offer an alternative to traditional 
textbooks and resources. According to the Organization for Economic Co-operation and 
Development (OECD), “the definition of OER currently most often used is ‘digitized mate¬ 
rials offered freely and openly for educators, students, and self-learners to use and reuse 
for teaching, learning, and research’” (OECD, 2007, p.10). In addition to potentially saving 
school and district resources, OER can also be adapted to individual circumstances, printed 
on demand or used in digital formats, and leveraged to enable new pedagogical practices. 


Background and Literature 


Despite over a decade of research, development, foundation funding, and other efforts, open 
educational resources (OER) have yet to show a discernable impact on public education in 
the United States. Open education resources are often used in distance education programs 
in a supplementary fashion alongside traditionally copyrighted materials (Butcher & Wil- 
son-Strydom, 2008). However, open textbooks can also be used in classrooms to replace 
expensive, proprietary textbooks. Several teachers in higher-education settings have exam¬ 
ined the possibility of substituting open textbooks for proprietary textbooks (e.g., Baker, 
2008; Baker, Thierstein, Fletcher, Kaur, & Emmons, 2009), but K-12 education has been 
slower to respond to the open textbook opportunity. This delay is partly attributable to text¬ 
book selection processes that are typically slow and bureaucratic (Armstrong & Bray, 1986; 
Watt, 2009; Frydenberg, Matkin, & Center, 2007). 

As public education budgets have tightened, open educational resources have become part 
of the educational conversation as a potential source of cost savings (Odden et al., 2007). 
However, in addition to bureaucratic adoption hurdles, educators lack appropriate re¬ 
search data to support a decision to use or reject open textbooks. But a small and growing 
body of research about OER effectiveness does exist. For example, OER allow teachers and 
students to remix content in locally meaningful ways (D’Antoni, 2009), to share a variety of 
types of learning resources (Downes, 2007), and to enable the best resources for teaching a 
specific topic to be more easily found (Gurrell & Wiley, 2008). OER have received consider¬ 
able attention in higher education (Baker, 2005; Koch, 2006), and researchers are exam¬ 
ining the question of how students are receiving open textbooks and how these textbooks 
affect student learning (Frith, 2009). Petrides, Jimes, Middleton-Detzner, Walling, and 
Weiss (2011) have begun a study examining how using an open textbook affects teacher and 
student experience. Nevertheless, no existing research empirically validates the arguments 
that (1) open educational resources can save K-12 public schools money, or (2) that open 
educational resources can promote deeper learning for students in K-12 public schools. 

Curriculum materials are an important part of student learning and represent a significant, 
recurring cost to public schools (Ansari, 2004). In the United States, core high-school sci¬ 
ence textbooks (without supplemental materials) from commercial publishers available on 
Amazon.com cost $8 o-$ 120 per copy, and teacher editions typically cost over $100 per 
copy. More problematically, the economic difficulties presented by the rising cost of text¬ 
books can translate directly into pedagogical challenges. In the best cases, where schools/ 
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districts can afford to provide students with up-to-date textbooks, these materials must be 
preserved and reused for several years. Consequently, this preservation mindset translates 
into prohibitions on student highlighting or note taking in textbooks, which makes study¬ 
ing cumbersome and difficult. This is unfortunate because annotating textbooks has been 
shown to be an effective learning strategy (Simpson & Nist, 1990; Lebow, Lick, & Hartman, 
2004; Wolfe & Neuwirth, 2001; Annis & Davis, 1978; Fowler & Baker, 1974). In other cases, 
students are forced to share books or go without them because their school or district can¬ 
not afford to purchase textbooks in a difficult budget year (Orfield & Lee, 2005). Clearly, 
textbook sharing arrangements prevent many students from being able to take books home 
for after-school study. 


Context of the Present Study 


As stated, this study examines issues of both the cost effectiveness and the educational ef¬ 
fectiveness of open textbooks compared to traditional textbooks. Figure 1 shows possible 
outcomes of this study. 


Decreased No change in Increased 

Money 
saved 


No 

change 
in cost 


Money 

lost 


learning _ learning _ learning 



















Figure 1. Possible outcomes in cost and education when using OER. 

In the present study, seven middle- or high-school science teachers in the state of Utah re¬ 
placed their commercial textbooks with open textbooks for one academic year. The teachers 
were instructed to continue to supplement the text with online and additional materials and 
activities in ways consistent with their previous classroom practices. 

The textbooks used in the study are published by the CK-12 Foundation, the largest pub¬ 
lisher of K-12 open textbooks in the United States. The CK-12 authoring model uses class¬ 
room teachers to do the initial writing, with subsequent review and refinement by subject- 
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matter experts (e.g., university faculty with PhDs in the content areas). 

In this article, we report three key findings from the study. First, we describe the costs of 
printing books during the 2010-2011 school year. Second, we explain how we applied les¬ 
sons learned from the 2010-2011 experience that significantly reduced the costs of print¬ 
ing books for the 2011-2012 school year. Finally, we discuss how students who used the 
open textbooks performed on the state’s standardized test for the 2011-2012 school year 
compared with students who studied the same subject under the same teachers in previous 
years using commercial textbooks. 


Participants 


Teacher participants were drawn from three of the largest public-school districts in Utah. 
These districts educate about one fourth of all Utah’s school children (approximately 
120,000) and employ over 4,000 teachers. Each teacher customized his/her open textbook 
to a different degree (editing, adding, and removing material), which drastically impacted 
the costs of the books, as described below. As instructed, teachers continued to supplement 
the open textbooks with additional resources and activities in exactly the same manner that 
they have historically supplemented traditional textbooks. 

Approximately 1,200 students used open textbooks during the 2010-2011 portion of this 
study. Most used printed versions of the open textbooks, while approximately 300 used 
online versions of the books on netbooks or iPads. 

At the beginning of the study, researchers and representatives from CK-12 met with par¬ 
ticipating teachers and provided one day of training regarding open educational resources, 
CK-12 textbooks, and the technical platform provided by CK-12 for adapting books; another 
full day of training was dedicated to hands-on practice in adapting textbooks with support 
provided directly by CK-12 personnel and researchers. 


Methodology: 2010-2011 


In order to determine whether a cost savings was associated with using open textbooks, we 
compared the price of adopting open textbooks to the price of adopting traditional text¬ 
books. Although significant effort can go into locating, vetting, and selecting open text¬ 
books, there is also significant effort put into locating, vetting, and selecting traditional 
textbooks. Consequently, we do not factor these costs into our comparison. 

Because open textbooks are designed to be adapted and modified for the local context in 
which they are used, the time spent in the adaptation process can be a significant factor 
in the cost of adopting such textbooks. Consequently, we explicitly accounted for the time 
teachers spent modifying open textbooks when comparing these costs to the market price of 
a comparable traditional textbook. The amount of time participating teachers spent modi¬ 
fying the open textbooks varied widely (see Table l). 
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Table l 

Summary of Teacher Efforts to Modify Open Textbooks 2010-2011 


Teacher identifier 

% of book modified 
(self-report) 

Hours spent modi¬ 
fying (self-report) 

Estimated modifi¬ 
cation cost 

Teacher A 

10% 

20 

$600.00 

Teacher B 

50% 

4 

$120.00 

Teacher C 

40% 

24 

$720.00 

Teacher D 

1% 

6 

$180.00 

Teacher E 

0% 

0 

$0.00 

Teacher F 

75 % 

60 

$1,800.00 

Teacher G 

17% 

10 

$300.00 


The reader may note that the amount of time spent does not correlate with the amount 
of modification (e.g., Teacher B spent 4 hours modifying 50% of the book, but Teacher C 
spent 24 hours modifying 40% of the book). This is true because some quick modifications 
can result in large changes to a book (e.g., removing chapters), while other changes that 
require a significant investment of time may only result in small percentage modifications 
(e.g., rewriting an example). Teacher E reported no modification because s/he adopted the 
modified textbook adapted by Teacher F. Teacher D made essentially no changes to his/her 
book. 

Once teachers had modified and adapted the textbooks according to their needs, CK-12 
personnel reviewed the textbooks for clarify and accuracy. (Because CK-12 provides these 
and other services freely to everyone, we do not factor these costs into our comparison.) 
Each teacher then chose the way he/she wanted the textbook to be bound and distributed 
to his/her students. Of the seven teachers, three (Teachers B, C, and D) chose a loose-leaf 
option (printed on three-hole-punched paper and assembled in a three-ring binder), two 
(Teachers E and F) chose to print with a perfect-bind option (a print-on-demand, paper¬ 
back format), and two chose to go completely digital with no printing. 

In calculating the total cost of implementing the open textbooks in classrooms, we (1) 
summed the money paid to teachers for participating in professional development/training 
activities, (2) estimated the monetary value of the unpaid time teachers spent making their 
adaptations (at a rate of $30 per hour), and (3) added these to the printing costs (including 
printing, binding, tax, and shipping or delivery costs). In calculating the total cost of tradi¬ 
tional textbooks, we obtained from the school district offices that handle textbook selection 
and purchasing the amounts that schools in our study typically spend on comparable tra¬ 
ditional textbooks. While shipping and other costs are certainly incurred when traditional 
textbooks are purchased, we do not account for these costs. Consequently, the cost of tradi- 
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tional textbooks is underestimated in our comparison. 


Cost Results: 2010-2011 


The cost data described above are summarized and juxtaposed with relevant student data 
in Table 2. 

Table 2 

Summary of Cost Data for Open and Traditional Textbooks 2010-2011 


Teacher 

identifier 

Cost of 

teacher 

modification 

efforts 

Cost of 

printing 
and ship¬ 
ping open 

textbook 

Total open 
textbook 

cost 

Traditional 

textbook 

cost (per 
year) 

Total sav¬ 
ings or 
(loss) of 
open text¬ 
book 

Students 

served 

Savings 
or (loss) 
of open 
textbook 

per stu¬ 
dent 

A 

$600.00 

$0.00 

$600.00 

$1,565-71 

$965.71 

137 

$ 7-05 

B 

$120.00 

$ 2,83947 

$ 2 , 959-47 

$2,514.29 

($ 445 - 18 ) 

220 

($2.02) 

C 

$720.00 

$ 4483 -i 3 

$5,203.13 

$2,171.43 

($3,031.70) 

190 

($15.96) 

D 

$180.00 

$ 9 , 935-36 

$10,115.36 

$2,811.43 

($ 7 , 303 - 93 ) 

246 

($29.69) 

E 

$0.00 

$918.47 

$918.47 

$1,280.00 

$ 361.53 

112 

$ 3-23 

F 

$1,800.00 

$ 1 , 574-16 

$ 3 , 374-16 

$2,171.43 

($1,202.73) 

190 

($ 6 . 33 ) 

G 

$300.00 

$0.00 

$300.00 

$2,308.57 

$2,008.57 

202 

$9.94 

Averages 

$ 531-43 

$2,821.51 

$ 3 , 352.94 

$ 2 , 117-55 

($1,235.39) 

185 

($ 4 - 83 ) 


As demonstrated in Table 2, the average cost of using open textbooks—across a range of lev¬ 
els of teacher adaptation effort, book lengths, students served, and final format—was higher 
than the cost of simply adopting a traditional textbook. However, it is also clear from Table 
2 that some of the specific models of using open textbooks were less expensive than simply 
adopting a traditional textbook. As we analyzed these differences, we began to understand 
the forces driving costs down on some of the textbooks. 
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Understanding Factors Impacting Cost 


Few of the teachers in the study invested significant adaptation efforts to prepare their 
textbooks before the school year. Several teachers decided that they would just begin the 
school year with the complete CK-12 textbook and mark sections for deletion throughout 
the school year. This approach resulted in books with large page counts and relatively high 
amounts of irrelevant content. This contributed to the higher costs of the most expensive 
open textbooks in the study. 

Once every tiling was printed, we were surprised to find that having the textbooks printed 
in a perfect-bound paperback format was cheaper than printing loose-leaf, three-hole- 
punched pages and putting them in three-ring binders. Many of the teachers believed that 
the loose-leaf approach would be less expensive when it was, in fact, much more expensive. 

Some teachers who used the less expensive print-on-demand approach wanted to print 
their books in several parts. Instead of a single 500-page book, for example, they printed 
five separate 100-page books. This tactic proved to be extremely expensive as the “setup” 
cost of running the print job was incurred five times rather than once. 

Finally, we did not print large numbers of any of the books (relative to publisher standards 
for large orders). Because significant printing discounts are tied to making very large orders 
(over 1,200 books for the best discounts from Lulu, a typical print-on-demand vendor), our 
smaller orders contributed to higher per-book costs. 

To summarize, the easiest way to spend more money on open textbooks than on traditional 
textbooks is to simultaneously 

• fail to exercise any of the adaptation/revision rights provided by open textbooks, adopt¬ 
ing longer books that contain unnecessary information; 

• print these longer books on loose-leaf paper and put them in three-ring binders; 

• disaggregate these longer books into multiple smaller books; and 

• print small numbers of the books (100-200 copies). 


Methodology: 2011-2012 


Based on the principles just described, we did things differently for the 2011-2012 school 
year. Teachers met together early and agreed to make careful revisions based on material 
they would actually need. In addition, we learned from Teacher E that when one teacher 
adopts another teacher’s book, the modification costs per adopting student significantly 
decrease. Thus, we brought teachers together from just one district and invited teachers in 
that district to make one textbook that all would use. This cut down on the number of ver¬ 
sions being created and thus on the overall modification costs. Many more teachers from 
the district participated in 2011-2012, resulting in more students being taught with open 
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textbooks (approximately 2,700 in 2011-2012 versus 1,200 in 2010-2011). While more 
teachers participated in the pilot, fewer teachers modified the books, thus amortizing the 
modification costs across many adopting students. Table 3 shows the costs of modifying 
textbooks this year. 

Table 3 

Summary of Teacher Efforts to Modify Open Textbooks 2011-2012 


Content area 

Hours spent modi¬ 
fying (estimated) 

Estimated modifi¬ 
cation cost 

Earth systems 

10 

$300.00 

Biology 

60 

$1,800.00 

Chemistry 

10 

$300.00 


Cost Results: 2011-2012 


Applying the lessons learned previously to printing the 2011-2012 set of open textbooks 
drastically decreased the cost of the books. Table 4 presents the new year’s data in the same 
format as Table 2 above. 

Table 4 

Summary of Cost Data for Open and Traditional Textbooks 2011-2012 


Content 

area 

Cost of teach¬ 
er modifica¬ 
tion efforts 

Cost of 
printing 
and ship¬ 
ping open 

textbook 

Total 

open 

textbook 

cost 

Traditional 

textbook 

cost (per 
year) 

Total 

savings 
or (loss) 
of open 

textbook 

Students 

served 

Savings 
or (loss) 
of open 
textbook 

per stu¬ 
dent 

Earth 

systems 

$300.00 

$3,726.18 

$4,026.18 

$8,458.20 

$4,302.02 

740 

$ 5-99 

Biology 

$1,800.00 

$6,695-64 

$ 8 , 495-64 

$13,716.00 

$5,220.36 

1,200 

$ 4-35 

Chemistry 

$300.00 

$ 3 , 978.08 

$4,278.08 

$8,572.50 

$4,294-42 

750 

$ 5-73 


As per Table 4, the average annual cost of a traditional textbook was $11.43. This figure rep¬ 
resents the cost of the textbook amortized over the seven-year replacement cycle. The aver¬ 
age cost of an open textbook was $5.14. This represents a savings of $6.29 per student per 
course per year. If a district of 10,000 students adopted open textbooks for its four science 
courses (earth science, biology, chemistry, and physics) over a seven-year adoption period, 
the savings would amount to $62,900 x 4 courses x 7 years, or $1,761,200. 
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The changes in implementation strategy made a large difference in cost. In the revised 
model used for the 2011-2012 school year, open textbooks represented a large cost savings 
for the district. To summarize, the easiest way to save money on open textbook adoptions 
compared to traditional textbooks is to simultaneously 

• exercise the adaptation/revision rights provided by open textbooks, removing all un¬ 
necessary information; 

• print these shorter books as black-and-white paperback books through a print-on-de- 
mand vendor such as Lulu.com; 

• print each book as a single book rather than disaggregating it into smaller pieces; and 

• print relatively large numbers of the books (ideally 1,000 copies or more). 


Methodology: Examining Student Test Scores 


Having demonstrated that open textbooks can decrease costs, a critically important ques¬ 
tion remains: What is the impact of these inexpensive open textbooks on student learning? 
We examined this question by using data from Utah’s annual standardized tests, known 
as the Criterion-Referenced Tests (CRT). Specifically, we compared the CRT scores of stu¬ 
dents whose teachers used the open textbooks to the CRT scores of those same teachers’ 
students in previous years. 

While our original design called for CRT scores for 2011 and the three previous years for 
every teacher, these data were not available. Some of the teachers in the study were new (no 
data beyond 2010) and some had changed schools, making it difficult to get data beyond 
2010. While these limitations were real, we did receive the 2011 and 2010 CRT scores for 
each teacher, as well as the 2009 scores for four of the participating teachers. These CRT 
scores, listed in Table 5, represent the percentage of students in each class who demon¬ 
strated proficiency on the exam. 

Table 5 

Summary of CRT Scores for Teachers Using Open Textbooks During Yean (2010-2011) 



Teacher A 

Teacher B 

Teacher C 

Teacher D 

Teacher E 

Teacher F 

Teacher G 

2009 

100 

N/A 

N/A 

N/A 

54 

59 

64 

2010 

99 

88 

89 

62 

44 

59 

69 

2011 

100 

83 

85 

61 

58 

82 

61 


Given so little data, we can only present a descriptive analysis. However, given the lack of 
research and data in the space overall, we feel that even a simple analysis is worthwhile. 
First, we calculate change scores from the 2010 and 2011 data and describe the measures of 
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central tendency of this small data set. Table 6 shows the change scores. 

Table 6 

Change in CRT Scores for Teachers Using Open Textbooks 2010-2011 

Teacher A Teacher B Teacher C Teacher D Teacher E Teacher F Teacher G 
Change +1 -5 -4 -1 +14 +23 -8 

The mean of this distribution is +2.86% and the median is -1%. By either measure of central 
tendency, the substitution of open textbooks for traditional textbooks does not appear to 
correlate with a significant change in student outcomes. For context, Table 7 presents the 
change in CRT scores statewide from 2010 to 2011 in the three content areas covered in this 
study, as reported by the Utah State Office of Education ( http://www.schools.utah.gov/ 
assessment/reports.aspx ). 

Table 7 

Statewide Changes in CRT Scores in Biology, Earth Systems, and Chemistry 2010-2011 



2010 

2011 

Change 

Biology 

72% 

72% 

0% 

Earth systems 

69% 

66% 

- 3 % 

Chemistry 

54 % 

52% 

-2% 


Adding the 2009 data where available will give a slightly more robust picture of what is 
happening. Table 8 shows the change between the 2011 scores and either the average of the 
2009 and 2010 scores (when both are available) or just the 2010 scores. 

Table 8 

Change in CRT Scores for Teachers Using Open Textbooks Comparing 2009-2010 Aver¬ 
age Scores with 2011 Scores 

Teacher A Teacher B Teacher C Teacher D Teacher E Teacher F Teacher G 
Change .5 -5 -4 -1 +9 +23 -5.5 

The mean of this distribution is +2.43% and the median of -1%. Again, by either measure 
of central tendency, the substitution of open textbooks for traditional textbooks does not 
appear to correlate with a meaningful change in student outcomes. 


Limitations and Discussion 


While there are ways to deploy open textbooks that actually add to curriculum costs (some 
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of these are identified above), models do exist that provide significant cost savings. The 
model described above reduced textbook costs by just under 40% in the first year (when 
the majority of the adaptation was performed) and by over 50% in subsequent years, when 
compared to the cost of using traditional textbooks. No change in educational outcomes 
was detected. Using the concept of Figure 1, Figure 2 shows the outcomes of this study. 


Money 

saved 


No 

change 
in cost 


Money 

lost 


Decreased No change in Increased 

learning _ learning _ learning 



, 

; 















Figure 2. Outcomes in cost and education in the present study. 

This study does have substantial limitations. First, it was carried out in the United States, 
where easy access to affordable print-on-demand services exists together with other factors 
that may confound the generalizability of the findings to other countries. In addition, the 
cost savings we realized only happened when we worked with a single district. We acknowl¬ 
edge these limitations and hope this initial study inspires others in both additional and 
larger contexts. 

Simply substituting open textbooks for traditional textbooks did not appear to have an ef¬ 
fect on student test scores. However, we stress the limited nature of the data presented 
above. Future studies need to expand both the number of teacher and student participants 
and the sophistication of the consequent analysis. 

One area of particular interest is the teachers whose classes saw relatively large (23% and 
14%) increases in their CRT scores after adopting open textbooks. One of these teachers 
said, “The better students write in their textbooks more.” If this comment turns out to be 
representative of a broader phenomenon, we hypothesize that student test scores will im¬ 
prove when professional development is provided to teachers to help them understand the 
new activities and pedagogies made possible by the open textbooks (e.g., students high¬ 
lighting and taking notes directly in their books). Even without significant improvements 
in student learning outcomes, reducing the cost of textbooks by half with no net loss in 
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learning appears to be a result of tremendous practical significance given the state of the 
global economy. 
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